Art Directable Retargeting for Streaming Video

We present a novel framework for content-aware and art-directable video retargeting. A simple and interactive workflow combines key frame based constraint editing with numerous automatic algorithms for video analysis. This combination gives content producers high level control of the retargeting process. The central component of our framework is a non-uniform, pixelaccurate warp to the target resolution which considers automatic as well as interactively defined features. Automatic features comprise video saliency, edge preservation at the pixel resolution, and a scene cut detection to enforce bilateral temporal coherence. Additional high level constraints concerning scene composition can be added by the producer. For high quality video display we adopted a 2D version of EWA splatting eliminating aliasing artifacts known from previous methods. Our method seamlessly integrates into postproduction and computes the reformatting in realtime. This allows us to retarget annotated video streams to arbitary devices while retaining the intended cinematographic scene composition.